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A  diffusion  observation  process  is  approximated 
by  a  Markov  chain.  The  information  obtained  by 
observing  the  Markov  chain  is  the  same  as  that 
obtained  by  observing  a  related  multivariate 
point  process.  Filtering  and  Zakai  equations 
are  obtained  for  multivariate  point  process 
observations.  These  Involve  Stieltjes  integrals 
rather  than  Ito  integrals  with  respect  to 
Brownian  motion,  and  so  they  provide  robust 
formulae,  that  is,  formulae  which  are  continuous 
in  the  observation  process. 
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ABSTRACT 

A  diffusion  observation  process  is  approximated 
by  a  Markov  chain.  The  information  obtained  by 
observing  the  Markov  chain  is  the  same  as  that 
obtained  by  observing  a  related  multivariate 
point  process.  Filtering  and  Zakai  equations 
are  obtained  for  multivariate  point  process 
observations.  These  involve  Stieltjes  integrals 
rather  than  Ito  integrals  with  respect  to 
Brownian  motion,  and  so  they  proide  robust 
formulae,  that  is,  formulae  which  are  continuous 
in  the  observation  process. 


1.  FILTERING 

All  processes  will  be  defined  on  a  complete  proba¬ 
bility  space  (n,  F,  P).  The  time  parameter 
t  e[o,«)  and  there  is  a  right  continuous,  complete 
filtration  { Ft }  on  n  with  respect  to  which  all 

processes  are  adapted.  Consider  two  independent 
Brownian  motions  { B^ }  =  {B^,  ....  B^),  { > 

=  {W^ . w®},  and  suppose  the  signal  process 

is  the  solution  of  the  stochastic  differential 
equation: 


dxt  =  f(xt)dt  ♦  o(xt)dBt 
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The  signal  is  not  observed  directly  but  by  means 
of  the  observation  process  {y t > ,  where  y^  cRn  is 

the  solution  of: 

dyt  =  h(xt)dt  +  dwt 

y0  -  0  cRn.  (2) 


For  simplicity  suppose  that  f,  o  and  h  are  bounded 
and  continuous,  and  the  solution  of  (1)  Is  unique 
in  the  sense  of  probability  distributions.  The 
following  formulation  of  the  non-linear  filtering 
problem  is  developed  in  detail  in  [1].  Write 

Y°  =  o{ys:s<tl  for  the  o-field  representing  the 

history  of  the  observation  process  up  to  time  t 
and  Y  =  { Y 1 1  for  the  right  continuous  complete 

filtration  generated  by  Y®.  The  best  estimate  in, 

say,  the  mean  square  sense  of  xt>  given  the 

history  Yt  is  Et*t 1 ^ determine  this 

conditional  distribution  it  is  enough  to  find 
E[0(xt)|Yt]  for  any  twice,  (or  even  infinitely), 

differentiable  real  valued  function  0  with  compact 

support  on  Rd.  Using  the  differentiation  rule 

0(xj  =  0(x  )  +  /l  L  0(x  )ds  +  rl  70-o(x JdB 

L  0  0  s  0  5  5 


where  L  is  the  second  order  operator 
m  _  ?  m 


L  = 


i  .J  =  l 


*ij(x) 


5V*j 


I  Mx) 

1*1  3Xi 


with  a  -  (a). j )  =  -io72. 

Write  *  for  the  Y-ootional  nrojection  so  that 
"t(0)  =  *(0(*t))  *  E[0(*t)|Yt].  Then  the  filter¬ 
ing  equation  [1]  for  *t(0)  is: 

t  t 

",.(0)  *  "-(0)  +  /  *  (L0)du  +  f  (u  (0h) 

l  O  q  u  0  u 

-  "u(0)  -u(h))*dvu  (3) 


Here  v,  the  innovations  process,  is  a  (Y,P) 
Brownian  motion  defined  by 


Dist 


.xles 


Avoii  and  (or 
Special 


Dnia 
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=  yt  -  fl  "(h)u  du  (4) 

Difficulties  with  Equation  (3)  are  that  it  is 
quadratic  in  n  and  involves  an  Ito  stochastic 
integral  with  respect  to  v. 


2.  APPROXIMATIONS  FOR  THE  OBSERVATIONS 

In  this  section  we  shall  describe  an  approximation 
to  the  observation  process  y  by  a  Markov 
chain.  Our  approximation  to  the  observation 
process  is  similar  to  that  for  diffusions  intro¬ 
duced  by  Kushner  [2].  The  resulting  (approximate) 
filtering  equations  involve  Stieltjes  integrals, 
rather  than  Ito  integrals  as  in  (3).  Why  should 
approximations  to  the  observation  process  be 
considered?  This  question  can  be  countered  by 
pointing  out  the  idealized  nature  of  a  diffusion, 
and  by  noting  that  all  measurements  are  approxi¬ 
mations,  so  that  at  some  level  of  accuracy  any 
observation  process  is  a  jump  process.  Alter¬ 
natively  we  could  just  say  we  wish  to  consider 
observations  of  this  form. 

To  approximate  the  process  {y t >  by  a  Markov  chain 
y4  consider  6>0  and  the  grid  R"  on  Rn  with 

O 

difference  parameter  6.  Write 

w  ■ "  *  ‘ w- 

bt4(xt)  «  6Z/Q6(xt). 

Write  £■  for  the  unit  vector  in  the  ith  coordi¬ 
nate  direction  of  Rn,  and  for  y  e  R",  y‘  *  y  +  «  e, 

0  “  I 

define: 

P5(y ,  y',  xt)  =  (1/2  ♦  5hr-  (xt))/Q6(xt).  (5) 

Then  P6(y,  y',  xt)  will  be  the  probability  of  a 
jump  from  y  to  y' ,  given  x^  and  given  there  is  a 
jump  at  time  t.  Also,  P4(y,  y',  xt)  >_  0  and 
t  P4(y.  y' .  x  )  *  1. 
y'  1 


The  conditional  distributions  of  the  jump  times  of 
the  approximating  Markov  process  (y4)  are  defined 
by: 


P  (next  jump  after  t  ♦  s  |  previous  jump  at  t  and 
x„*  t  <  u  <  t  ♦  sj  • 


exp  (-  / 


s+t 


du 


at6(xu) 


)• 


(6) 


The  signal  { xt >  enters  the  Markov  chain  {y6} 


through  (5)  and  (6).  We  can  then  establish 

LEMMA  2.1.  If  y‘  *  y  +  6  e  is  the  next  state 
value  E[y  -  y'|xt]  =  M*t>  *t4(xt)  and 

Cov[y‘  -  y | xt J  =  Iit4(xt)  +  o(at 4(xt))  where  I 
is  n  x  n  identity  matrix. 

REMARKS  2.2.  The  approximating  Markov  chain  (y4), 
with  state  space  R?,  is  determined  by  a  sequence 

of  jump  times  (T . } ,  1  *  1,2 .  and  a  sequence 

of  positive  or  negative  unit  vectors  {+  c^)  in  Rn 

which  describes  the  jump  values.  That  Is,  the 
Markov  chain  can  be  thought  of  as  a  marked  point 
process  ((Tn>  Zn ) > ,  with  jump  times  Tn  and  jumps 

Zn  in  the  state  space  (♦  t^}.  In  turn,  this 

marked  point  process  can  be  considered  as  a  multi¬ 
variate  point  process 

Nt  -  (Nt(+  1),  Nt(-  1) . Nt(-  n)) 

where  N  (+  i)  =  z  I(t>T  )  I(Z  *  +  e.) 

1  ~  n>l  "  n  -  l 

The  distribution  of  the  jump  times  Tn  is  given  by 

(6),  so  roughly 

P<Vl  =  t  +  s|Tn  =  t.  Tn+1  >  t  ♦  s  and  xu. 
tiuit<  +  s) 

■  .  Q.lx,,,)/*2- 

Also,  P(Zn  =  +  cilTn  *  t  *n<1  xt) 

=  (1/2  Hhj-  (xt))/Q{(t).  These  two  condi¬ 
tional  probabilities  determine  the  Levy  system 

(see  [1])  of  the  approximating  Markov  chain  y4. 
Write 

»+1(t)  •  (1  ♦  2  6  h*  (xt))/2«Z. 

Then  we  can  show  the  processes 
*  Nt(+  i)  -  /l  x+1(u)  du 

are  { }  martingales.  The  X  ^  are,  therefore,  the 
intensities  (see  [1]  of  the  point  processes  N(+  1). 

3.  FILTERING  WITH  MULTIVARIATE  POINT 
PROCESS  OBSERVATIONS 

We  have  described  an  approximation  to  the  original 
filtering  problem  in  which  the  signal  modulates  a 
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multivariate  point  process 

Nt  =  ( Nt {+  i )  ,  i  -  1 . n).  Write 


Then  A  is  an  (F,  )  martingale,  At>0  a.s.  and 

E C t ]  =  1.  Define  a  new  probability  measure 

P  =  P.  by 


Y  =  a(Ns  :  s-t} 


and  Y6  =  { Y ^ }  for  the  right  continuous, 
complete  filtration  generated  by  the  Y°s.  Suppose 

“  ^  A 

(0.)  is  a  process.  Then  (0,)  will  denote  the  Y 

optional  projection  of  { 0^ }  and  { 0t }  will  denote 

the  Y6  predictable  projection.  Then  we  have  the 
fundamental  result: 

LEMMA  3.1.  qj  =  N.(i)  -  f*  A.(u)du  is  a  Y5- 
t  t  o' 

martingale  for  1  =  +  1,  . . . ,  ♦  n. 

The  filtering  equation  for  0(xt)  with  observation 

process  N  is  proved  similarly  to  that  in  [1], 
and  states  the  following: 

THEOREM  3.2  0(xt)  *  0(xq) 

t  -  1R  t  i 

+  /  L0  du  +  1  r  Yu  d(V,  (?) 

o  i=  +1  o  u  u 


^dP^'V  =  V 


Here  E^  denotes  expectation  with  respect  to  P^. 

An  application  of  Baye's  rule  establishes  the 
following  result: 


LEW4A  3.4.  Under  P  =  P^  the  processes 


=  Nt(i)  -  /*  a 1 ( u )  du. 


i  =  +1 . +n  are  {F.}-  martingales. 

NOTATION  3.5.  Write  A  for  the  Y5-opt1onal  pro¬ 
jection  of  A  under  P, .  Then  for  each  t>0 

t  * 

At  *  E^a  |Yt]a.s.  and  a  Is  a  locally  square 
integrable  (Y4,  P1 )  martingale.  Because  we  now 
have  the  two  measures  P-j  and  P  *  P^.  for  any 
process  c  *  (t^}  we  shall  write  x(c),  resp.  *p(c), 

for  the  (Y'\  P)  optional,  resp.  predictable,  pro¬ 
jection  of  Therefore, 


Yu  *  Wxu>  Vu)  *  ^(“))(^(“))" 


n  (x .(u))  =  EC*i(u)lYj_]  a.s. 


REMARKS  3.3.  The  Ito  stochastic  integral  in  (3) 
is  now  replaced  by  the  (robust)  Stieltjes  inte- 

i 

grals  with  respect  to  the  Q  .  However,  the  y 

still  involve  a  product  of  projections  and/or  a 

■ 

division  by  A^u).  These  difficulties  can  be 

circumvented  by  considering  a  different  probability 
measure  P^ . 

Suppose  that  under  P^,  (the  reference  probability), 

each  component  N(i)  of  the  multivariate  point 
process 

N  -  (N(*  1),  (N(-  1) . N(+  n).  N(-  n)) 

is  a  standard  Poisson  process  of  intensity  1.  Then 
for  1  «  +1 . +n 


for  i  =  +1 ,  . . . ,  +n. 

LEMMA  3.6.  -  1  ♦  i  .£*,  0*  dQ* 

where  0’  *  \iJnp(Mu^  *  !)• 


REMARKS  3.7.  Using  the  w  notation.  Theorem  3.2 
states: 


'(0(0)  -  «(0(xj)  ♦  r  x(L0(x  ) )du  ♦ 

l  O  0  u 


i=  +1  v1  dQ1 
-  o  u  Mu 


Qt  *  Nt(1)  -  t 


Is  a  Y°-  martingale  under  P^.  Consider  the  *^i- 
of  exponentials 

-n  t  < 

At  *  1  +  I  r  A  (A.(u)-l)  dQ’. 

1  i.  o  u  1  u 


=  <«p(i(xu)  xi(u))  *  "Wxu)}  V(N(U)) 


np('i <u) )_1 ■ 


(9) 


Now  by  Baye's  formula: 


r 


4  OF  4 


i 


«(0(xt))  =  E[0(*t)|Yj] 

-  E1[Atl(xt)|Yj]  (E1CAt|Yj])~1 

*  o(0(xt))  o(l)'1. 

where  o(0(xt))  =■  E ^ [ A t  0 (xfc ) | Y*] 

Is  an  unnormalized  conditional  expectation  and 
o(l)  =>  At- 

Therefore,  o(0(xt))  =  a{  *{(9{xt))  and  by  computing 

the  product  of  (10)  and  (11)  we  obtain  the  follow¬ 
ing  Zakai  equation  for  o(0(xt)): 

THEOREM  3.8.  a(0(xt))  =  a(0(x  ))  + 

/*  o(L0(x  ) )  du  ♦  ?  /*  o(0(x  )(x.  (u)  -  1)) 

o  u  i=  +1  o  u  1 

dOj.  (12) 


REMARKS  3.9.  The  advantages  of  equation  (12)  are 
that  it  is  linear  in  a  and,  because  it  involves 
only  Stieltjes  integrals  with  respect  to  the 

Poisson  processes  Q1,  it  is  robust. 

The  remaining  questions  concern  the  convergence 
of  the  approximate  filters  as  the  mesh  size  « 
goes  to  zero.  In  fact  it  can  be  shown  that  the 
family  of  filtered  processes  given  by  Theorem  3.2. 
for  6>0  is  tight  and  converges  weakly  to  the 
process  given  by  (3)  as  6-*0. 


o(0(xt))  =  E,[0(xt)  aJ|Y J] 
is  then: 

o(0(xj)  «  o(0(xj)  *  ft  o(L0(x  ))  du 

t  U  Q  u 

♦  2l  ft  a(0(x  )  h.)6  dff14  •  (14) 

i=  +1  o  u  i  u 

Now  the  family  of  processes  given  by  (14)  for  6>0 
is  tight  and  converges  weakly  as  A-0  to  a  process 
o(0(xt))  which  is  the  solution  of: 

o(0(xj)  =  o(0(xj)  ♦  ft  o(L0(x  )  du 

t  U  0  u 

in  t  i 

*  2  Z  r  o(0(x  )  h. (x  ) )dw‘ 

i=  +1  O  U  1  u  u 

where  w  *  (w+1 ,  w'1 . w+n,  w‘n)  Is  a  Brownian 

motion. 
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However,  the  family  of  processes  given  by  the 
Zakai  equation  (12)  does  not  converge  as  A-*0.  To 
obtain  a  convergent  set  of  processes  one  must 
assume  that  for  each  <5>0  there  is  a  multivariate 

point  process  nJ  *  (nJ(+1),  nJ(-1) . N*(-n)) 

such  that  under  the  reference  measure  P,  each 

2  6 

component  Is  a  point  process  with  rate  t/s  .  At 
is  defined  by: 

a!  *  1  +  E  A*  (262  x,(u)  -  1)  dff14  (13) 
t  i«  o  u  1  u 

where  Q^4  «  N4(1)  -  t/<52. 

A  new  probability  measure  P4  is  given  by: 


A 


6 

r 


The  Zakai  equation  for: 


